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Abstract. We will show under very weak conditions on differentiability and 
dependence that the central limit theorem for quantiles holds and that the 
block bootstrap is weakly consistent. Under slightly stronger conditions, the 
bootstrap is strongly consistent. Without the differentiability condition, quan- 
tiles might have a non-normal asymptotic distribution and the bootstrap might 
fail. 



1. Limit Behaviour of Quantiles 

Let (X n ) n£Z be a stationary sequence of real- valued random variables with dis- 
tribution function F and p £ (0, 1). Then the p-quantile t p of F is defined as 

t p := F- 1 (p) := inf {t G R\F (t) > p} 

and can be estimated by the empirical p-quantile, i.e. the |~^]-th order statistic of 
the sample X\ . . . , X n . This also can be expressed as the p-quantile F~ x (p) of the 
empirical distribution function F n (i) := ~ Y^i=i ^x t <t- It is clear that F^ 1 (p) is 
greater than t p iff F n (t p ) is smaller than p. This relation between the empirical 
quantile and the empirical distribution function was made more precise by Bahadur. 
Under the condition that the random variables X\ , . . . , X n are independent and that 
F is differentiable twice in a neighborhood of t p , he proved that 

F^(p)~t p = P —I^+R n , 

where / = F' is the derivative of the distribution function and R = 0(n~i logn) 
almost surely. Ghosh (1971) established a weak form of the Bahadur representation, 

only assuming that F is differentiable once in t p . He showed that R n = op (n 

under this condition, meaning that y/nR n converges to in probability. As noted by 
Lahiri (1992), the condition that F is differentiable is also necessary for the central 
limit theorem for F~ 1 (p). Weiss (1971) derived the nonnormal limit distribution of 
quantiles if the densitiy has a jump in t p . De Haan and Taconis-Haantjes (1979) and 
Ghosh and Sukhatme (1981) investigated the asymptotic distribution for _F J 7 1 (p), if 
F is not differentiable, but regular varying. We will extend their results to strongly 
mixing random variables. 

There is a broad literature on the Bahadur representation for strongly mixing 
data. Babu and Singh (1978) proved such a representation under an exponen- 
tially fast decay of the strong mixing coefficients, this was weakened by Yoshihara 
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(1995), Sun (2006) and Wendler (2011) to a polynomial decay of the strong mixing 
coefficients. All these articles deal with the case that F is differentiable. 

Definition 1.1. Let (A„) ngZ be a stationary process. Then the strong mixing 
coefficients are defined as 

(1) a(k) := sup [\P[AB] - P[A]P[B}\ : A e F[\B e F™ +k ,n € Z} 

where T a is the a-field generated by random variables X a , . . . , Xi. We say that 
(X n ) ngZ is strongly mixing if lim^oo a(k) = 0. 

For further information on strong mixing and a detailed description of the other 
mixing assumptions, see Bradley (2007). 

The paper is organized at follows: We will start with our asymptotic results for 
sample quantiles. In the next section, we will introduce the bootstrap procedure 
and give theorems about the consistency for the bootstrap. In the third section, 
we will provide the proofs of our results. Our first theorem is a nonlinear version 
of the weak Bahadur representation under mild mixing assumptions: 

Theorem 1. Let (A„) ngZ be a stationary, strongly mixing sequence of random 
variables with distribution function F , such that for a p > 

F(tp + h)- F(t p ) = M\h\P sgn(h) + o(\h\P) 

as h — » and X)»^Li a ( n ) < 00 • Then 

F- 1 (p) -tp= ( b ~^ fa)l ) ' sgn (P - F n (t p) ) + R ni 

where R n = op(n~ip). 

The mixing assumption in this Theorem is milder than in the article of Sun 
(2006), who assumed that a(n) = 0(n~ a ) for an a > 10, and in the article of 
Wendler (2011), who assumed that a > 3, but in these theorems, the convergence 
is almost surely. An easy example of distribution function of the above form is 
F(t) = i|^sgn(i) + i forte [-1,1] and p = \. 

By Theorem 1.6 of Ibragimov (1962), the summability of the mixing coefficients 
is a sufficient condition for the central limit theorem of partial sums of bounded 
random variables, so we obtain with the help of the above representation: 

Theorem 2. If the assumptions of Theorem^ hold, then n^p (F,^ 1 (p) — t p ) con- 
verges in distribution to C\W\? sgn(W), where C is a constant and W is a normal 
distributed random variable. 

For the special case p = 1 (differentiability), we get Lemma 5.1 of Sun and 
Lahiri (2006) (central limit theorem for F^ 1 (p)), as \ W\ sgn(PF) = W is normally 
distributed. Note that X^^Li a ( n ) < oo is the best known condition for the central 
limit theorem for bounded random variables and that the central limit theorem 
might fail if one just assumes that a(n) = O(-), see remark 10.11 in the book 
of Bradley (2007). So it is not possible to establish asymptotic normality of the 
sample quantile under this condition. 

In the other case p ^ 1, the limit C|PF|p sgn(W) has a nonnormal distribution. 
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2. Block Bootstrap for Quantiles 

The statistical inference for quantiles is a dificult task, many methods rely on 
estimates of the unknown density. An alternative method is the Bootstrap. Bickel 
and Freedman (1981) established the consistency of the Bootstrap for quantiles for 
independent data, more work on this topic was done by Ghosh et. al (1984) and 
Babu (1986). 

For dependent data, normal approximation becomes even more difficult, but 
there is up to our knowledge only one article about the bootstrap for quantiles under 
dependence: Sun and Lahiri (2006) have shown the strong consistency (almost sure 
convergence to the right limit) of the bootstrap under strong mixing. We will 
establish a weak Bahadur representation for the bootstrap version of the quantile 
and will conclude that the bootstrap is weakly consistent for p = 1, that means 
the bootstrap distribution function converges in probabilty to the same limit as the 
true distribution function. The bootstrap is not consistent for p ^ 1. 

There are different ways to resample blocks, for example the circular block boot- 
strap or the moving block bootstrap (for a detailed description of the different 
bootstrapping methods see Lahiri (2003)). We consider the circular block boot- 
strap introduced by Politis and Romano (1992). Instead of the original sample of n 
observations with an unknown distribution, construct new samples X*, . . . ,X£ t as 
follows: Extend the sample X\, . . . ,X n periodically by X i+n = X i: choose blocks 
of I = l n consecutive observations of the sample randomly and repeat that b = |_yj 
times independently: For j = 1, . . . , n, k = 0, . . . , b — 1 

P * {xti+i = x j> ■ ■ ■ ) x (k+i)i = x j+l-i) = -, 

where P* is the bootstrap distribution conditionally on (X n ) neN , E* and Var* are 
the conditional expectation and variance. For the circular block bootstrap version 
of the sample mean, Radulovic (1996) has established weak consistency under very 
weak conditions. 

^n(*) = Ti Si=i l{x*<t} denotes the Bootstrap version of the empirical distri- 
bution function and F*~ 1 {p) the p-quantile of the bootstrap sample. 

Theorem 3. Let {X n ) nl - Z be a stationary, strongly mixing sequence of random 
variables with distribution function F , such that for a p > and M =/= 

F(t p + h)- F(t p ) = M\h\ p sgn(/i) + o(h) 

as h — > and Y^?=i a ( n ) < 00 • Furthermore, choose the block length in such a way 
that j + i^0. Then 

FT' (P) ~t P = ( b '^ fa)l ) " sgn(p - F* (t p )) + R* n , 

where i?* = op(n^^p). 

Note that we do not center F*^ 1 (p) with respect to the bootstrapped expecta- 
tion, but with respect to the true quantile t p . With the help of this theorem, we 
get weak consistency (convergence in probability) in the case p = 1. For p ^ 1 we 
will get inconsistency. 
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Corollary 1. If the assumptions of Theorem^ hold with p = 1 and additionally 
lim n ^oo Var[ v / nF„(i p )] > 0, then 

sup \P* (F*- 1 (p) - F- 1 (p) <t)-P (F~ x (p) -t p <t)\ ^> 
teR 

in probability. 

The assumptions of this corollary cannot be weakend: It is well known that 
I —> oo and n/l — > oo are necessary for bootstrap consistency of the bootstrap. The 
mixing rate is the best known rate for the central limit theorem. As asymptotic 
normality might still hold for the bootstrap under slower mixing rates (see Peligrad 
(1998)), the bootstrap might be inconsistent. Finally, if p ^ 1, the bootstrap also 
fails: 

Corollary 2. // the assumptions of Theorem^ hold with p 1 and additionally 
lim„^oo Yai[y/nF n {t p )] > 0, then 

sup |P* {F*- 1 (p) - F- 1 (p) <t)-P (F- 1 (p) -t p <t)\ Z p 
ten. 

in distribution, where Z p is a non- degenerate (non- constant) random variable. 

The reason for the inconsistency in the case p ^ 1 is that the shape of the 
distribution function F at F~ (p) (the centering for the bootstrap quantile) is 
different from the shape of F at t v (the centering for the empirical quantile). If F 
is differentiable (p = 1), the shape at the two points is asymptotically the same, as 
Fa 1 (p) -> V 

We also want to establish the strong consistency and we need slightly stronger 
conditions on the mixing coefficients and the block length: 

Theorem 4. Let (X n ) n£Z be a stationary, strongly mixing sequence of random 
variables with distribution function F which is differentiable in t p with positive 
derivative f. We assume that the mixing coefficients satisfy a(n) — 0(n~ 1 ~ f -) 
for an e > 0. Furthermore, choose the block length in such a way that for some 
constants Ci, C2, e\ > 

Cm 61 <l n < C 2 n 1 - £l 

and for all k € IN 

_ fc = = ■ ■ • = ^2 A + 1 — 1 ■ 

Then 

*r 1 ( P ) - F- 1 ^) = Fn{tp) ~ t ^ {tp) + K, 

where i?* = o* P (n~^) almost surely. 

With this Bahadur-Ghosh representation and Theorem 2.4 of Shao and Yu 
(1993), the strong consistency of the bootstrap follows easily: 

Corollary 3. If the assumptions of Theorem^hold and lirrin._j.oo Va,T[y/nF n (t p )] > 
0, then 

sup |P* (Ff 1 (p) - F' 1 (p) <t)-P (F- 1 ( P ) -t p <t)\ ^> 
ten. 

almost surely. 
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Compared to Theorem 3.1 of Sun and Lahiri (2006), our assumptions on the 
mixing coefficient a(n), on the distribution function F and on the block length I 
are weaker. They assume that a(n) — 0(n~ a ) for an a > 9, 5, that I = 0(77,2 ) and 
that F is continuously differentiable in a neighborhood of t p . 



3. Proofs 

In the proofs, C denotes an arbitrary constant, which may have different values 
from line to line and may depend on several other values, but not on n £ IN. We 
use the following lemma proved by Ghosh (1971): 

Lemma 3.1. Let {V n ) n ^ o,nd (W n )„ e fj be two sequences of random variables, 
such that 

(1) the sequence (Wn)neJsr * s tight, 

(2) For allk£R and e > 



lim P <V n < k, W n > k + e) = 

■a—too 

lim P (V n > k + e, W n < k) = 0. 



Then V n — W n — > in probabality as n —¥ oo. 

Proof of Theorem^ The proof follows the ideas of Ghosh (1971). We set g(x) — 
M\x\ p sgn(x) and W n = g- 1 {^/n~(p-F n {t p ))). By Theorem 1.6 of Ibragimov (1962), 
\/n(p — F n (t p )) converges to a normal limit and thus (W n )n&s is tight. We define 
V n = n^{F~ l (p) - tp) and Z t , n = g- l {^i{F{t p + ^) - F n (t p + ^))). We 
have that by the definition of the generalized inverse 



{V n <t}= \ p<F n (t 



,l/2p. 



) > = {Z t ,n < tn} 



where t n := g 1 (y/n(F(t p + i* 2p ) — p))- By our assumptions on F, for all t 6 R we 
have that t n — > t as n — > oo. We assumed that YlkLi a (k) < oo. By a well-known 

< 4a(fc - 1), so 



covariance inequality Cov \^-{t p <Xi 
we have that 

e(^(p- F n (t p ) - F(t p + + F n (t p + - J^) 



< 2 



|C0V (t {tp<Xl < tp + _!_ } , t {tp<Xk < tp + _!_. } 



k=l 



LnlJ 

< 2 £ Var (l {tp<Xl < 4p+ ^ 
fe=i 



72p- 



< 2n* 



F{t p 



8 y, «( fc ) 

fc=Ln?J 

t s 



,l/2p< 



.8 Y «W^0, 

fc=Ln^J 
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so y/n(p-F n (t p )-F (t p +^ /w )+F n (tp+^r r ^)) -> in probability and consequently 
Zt, n — W n — > in probability as n — > oo. So 

lim P (V n <t,W n >t + e) = lim P (Z t . n <t n ,W n >t + e) 

n— >oo n— »-oo 

< lim P (z t ,n < t + W n > t + e) = 0. 

Tl — ^ OO \ Z / 

Lemma [3H] completes the proof. □ 

We omit the proof of Theorem [5J as we think it is an obvious consequence of 
Theorem [1] and the continuous mapping theorem. 

Proof of Theorem [3J We will use a similar method as in the proof of Theorem [T] 
We define 

W*:=g~ l (ybl(jp-F*{t p ))), 
V:-.= (bl)^ (F^ 1 (p) — t p ), 
Kn 9- 1 (Vbl{F(tp + - F;(tp + ^))) 

Note that \/bl(F n (t p ) — F*(t p )) converges to a normal limit by Theorem 2 of 
Radulovic (1996), so the sequence (y/bl((p — F n {t p )) + (F n (t p ) — F*(t p ))) ne n is 
tight and consequently the sequence (W*) n& n is also tight. It remains to show for 
any t 6 R that Z^ n — W* — >■ in probability as n — > oo. By the construction of 
the circular block bootstrap E*F*(t) = F n (t), so 

EE* (Vbi (f^ + FZ(tp + -Lrf -p + F*(t p ^j ) 

=EE* (Vbl (F n (t p + -j^) - F*(t p + -±^) - F n (t p ) + F*(t p )\\ 
+ E (Vbl (F{tp + -*-) - F n (t p + _*_)- p + Fn (t p f) ) . 

In the proof of Theorem [TJ we have already shown that the second summand con- 
verges to zero. For the first summand, we conclude from the conditional indepen- 
dence of the resampled blocks and the definition of empirical distribution function 

EE* (Vbl (F n (t p + -i^) - F*(t p + F n (t p ) + F*(t p ^j ) 

( t 1 1 1 1 V 

= IEE* F n (t p + - w ) - - l { i.< ir+ -4) - F n (t p ) + hx;< h} ■ 
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With probability we have (X$, . . -,Xf) = (X j+1 ,. . .,X j+ i) (with X t = X 4 _„ 
for i > n). so 

/ t 1 ' 1 1 \ 2 

lEE * F n (t p + ^jr P ) - y E V^+^i - + y E !w<*p} 

\ 2—1 l—l / 

= - E E ( F ™^f + i) -?E 1 {^+i<*p+^w1 - F "^p) + 7 E 1 {^+ ! <*p} ) 

3=1 \ i=l i=l / 

< (V n (t p + - F(t p + -^) - F n (t p ) + F(t p )) 

+ 21E (f^ + -±^) - F(t p + -L- p ) - Fi(t p ) + Fit,)) . 

These two summands converge to as in the proof of Theorem [TJ which completes 
the proof. □ 



Proof of Corollary^ By Theorem 2 of Radulovic (1996) 
sup \P* {Vn(F n (t p ) -p)<t)-P(Y <t)\ 



J ->0 



and 



sup 

ten 



P* (Vbl(F*(t p ) - F n {t p )) <t)-P(Y<t) 



±>0 



in probability for some normal random variable Y. Furthermore by Theorems Q] 
and [3] 

p - F n (t p ) 



Fn L (p) - t p 



M 



R„ 



and 



K' 1 (p) - f- 1 (p) = (K- 1 (p) tp) (f- 1 (p) - tp) 



P - K (tp) p — F n (tp^ D * D F n (tp) - F* (t p ) + R ,_ R ^ 



M M 1 " n "'" M 

where R n = op(n~%) and _R* = op(n~^). So we can conclude that 

sup \P* (F;- 1 (p) - F- 1 (p) <t)-P (F- 1 (p) -t p <t)\ 
ten 



< sup 



P* (VbliF*- 1 (p) - F~ l (p)) <t)-p[^ r <t 



+ sup 

ten 



P* (V^(F n (p) -t p )<t)-P[-—<t 



Y 



-> 



in probability. 

Proof of Corollary [H By Theorems [1] and [3l we have that 

Ftr\p) - F-\p) = g-\p ~ F* (t p )) ~ g-\p - F n (tp)) + R n + R* n 



□ 
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with R n + R*= o P {n 2 ? ), so 



sup 

teR 



P 



sup 

teR 



P 



-P* (g-HV^ip-F* (t p )))-g-\V^(p-F n (<„))) < i)| 
in probability. Furthermore 

(niOl-t^ij-p^-^y))^)! - 

So it follows that 

P* (n^iF^ip) - F-\p)) <t)-P (n^(F-\p) - t p ) < t) 

hm sup \P* (g-^V^ip - K ^p))) - ff _1 (V»(P - F « (*p))) < *) 



±>0 



> 0. 



lim sup 

n ^°° teR 



! teR 



-pOr^fr-i^))) <t)| 



To investigate the latter, note that by Theorem 2 of Radulovic (1996), y/n(p — 
F n (tp)) and y/n(F n (t p ) — F* (t p )) converge in distribution to two independent 
normal random variables W\ and W% with the same variance. So 

sup |P* (g-\V^(p-F* (tp^-g-W^fr-Fn (tp))) < t) 



teR 



-* > (0~ 1 (Vn(p-.F n (t I ,)))<t)| 



^-^> sup|P(s _1 (Wi + W 2 ) -S _1 (W 2 ) < t\W 2 ) -P(g' 1 (W 1 ) <t)\=: Z p 
teR 

in distribution, where W\ and W2 are two independent normal random variables. 
As the functions x — > g {x + y) — g~ l {y) and x — > g (x) are not identical for 
y 7^ 0, the random variable Z p is not 0. □ 

Proof of Theorem^ We define a n = 2 k for the fc 6 IN such that 2 k < n < 2 k+1 . 



1 



{x*<t v }) , 



1 " / t 

Zt,n ■ = —= Pn(tp + —7=) ~ ^{X*<t p +-A-} ~ F n (tp) + l{X*<t p } 

Following the arguments of the proof of Theorem [TJ we only have to show that the 
sequence {W n )n£K is tight and that Zt, n — > in bootstrap probability for all £ e R 
almost surely. By Theorem 2.4 of Shao and Yu (1993), {y/n(F n (t p ) - F*(t p ))) neK 
is almost surely asymptotically normal and thus (W n ) n ^ is tight. 

First note that by the construction of the bootstrap random variables, the sum- 
mands of Zt, n are independent conditional on X%, . . . ,X n when the indices i lie 
in different blocks. Additionally, the random variables are centered in bootstrap 
probability and the sequence of blocks are stationary for fixed n. So 



E 



*(X«) 2 

Lfj-Var* 

hi U>n 



F n (t p + —) - l {X *< tp+ t } - P n (tp) + t{X*<t p } 
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Recall that the bootstrap random variables X*, . . . , Xf take the values Xj, . . . , Xj+i-i 
for j = 1, . . . , n with probability — and that we have to set Xj = Xj_ n for j > n. 
So we have the following upper bound for the bootstrap variance: 



Var* £(F n (i p + -— <t p + -^} - Fn{tp) + l{X*<t„ 

_. =1 \ v a « 

; n E m ™ ax i E ( + - 1 {^<*p+7fc> " + ) 

j—l y j =J - V « / y 

1 " lj+m-1, t s\ 2 

^-E m ^ ax ; E ( J? (*p + -^=)- 1 {^<tp+^ r }- J? (*i')+ 1 {^<*,}) 



> 2 ' 1: ' ' -L) - F(i p + -L) - F n (t p ) + F(tp) 



2^ n I F n (t f 



To show the convergence of the bootstrap variance, we now need moment bounds 
for the maximum of the partial sums. By the inequality of Davydov (1970), we 
have that 



Cov (t {Xl < tp+ _t_ } - t {Xl <t p }A{X 1+k <t p +- 7 L, 



} - HXi+k<t P } 



< Ca—>(k)(-—)—e 



as \F(t p ) — F(t p + ft) | < C\h\. By standard calculations 

°° 2 t 

< 2m^2Ca^ (fc)(— =)* < Cma„ ; 
k=i V s ™ 

We obtain the following maximal inequality by Theorem 3 of Moricz (1976) 



E max 

\ m=l,..., 



F (t P + -7=)- V«<tp+db> F(t p ) + l {Xi < tp} 



< CI log 2 la r , 



To simplify the notation, we set 

Y n (i) := F(t p + -±=) - t {Xt < tp+ t } - F(t p ) + l { x 1 < tp} 

\/ a n v " 
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By the Chebyshev inequality 



E^( 



max 

=2 fc ,...,2 fc + 1 -l 



oo 



>S) 



n , 1 2 



^'+m — 1 



max 

n=2 fe ,...,2 fc -t 



+ ^f> max [fj-^f-E^wl 

1 °° 1 / m \ 2 

^«E 8 ^ max E y »(*) 

k=l z V i=l / 



+ iE 4 ^( max W„(i) 

OO oo 

< C^log 2 (J 2fe )a~* + C^log 2 (a 2fc )a~* < oo. 



fc=i 



fe=i 



With the Borel-Cantelli-lemma, we have that Z t . n converges to almost surely for 
alH € R and the proof is complete. □ 
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